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METHOD OF PROCESSING TEST PATTERNS FOR AN INTEGRATED CIRCUIT 

Background of the Invention : 
Field of the Invention : 
To achieve high performance and high integration density, the 
dimensions of integrated circuit components are scaled down 
more and more. In particular, transistor dimensions are 
scaled down while lower power dissipation is achieved by 
scaling down the supply voltage. However, due to high packing 
density of transistors, the power supply current is 
increasing, and hence, large current swings within a short 
period of time can cause considerable noise. As a 
consequence, one difficulty circuit designers face is the 
power delivery of very high performance circuits due to the 
severe switching noise. 

In order to verify the function of a newly designed integrated 
circuit, the circuit is first simulated and then tested. 
During simulation, multiple input signals are applied to the 
inputs of the circuit, and the output signals of the circuit 
calculated. The input signals are referred to as test 
patterns. If the output signals do not sufficiently 
approximate preset target signals, the circuit is redesigned 
and re -simulated. 
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Subsequently, when simulation is completed, a chip containing 
the integrated circuit is manufactured and tested using ATE 
(Automatic Test Equipment) . The ATE also applies a test 
5 pattern to the circuit. The test pattern for the ATE has to 
be input manually by a user. Generally, the same test pattern 
that has been used for simulation is also used for testing. 
If the output signals generated by the circuit in response to 
the test pattern of the ATE deviate from preset target 
10 signals, the circuit is redesigned, re-simulated and retested. 

As the complexity of integrated circuits increases, 
integration density and functionality increases dramatically. 
The simultaneous switching of a large number of transistors 
15 induces a large current spike. The switching noise on the 

power distribution network must be suppressed to a tolerable 
level to ensure the reliability of the circuit. In order to 
efficiently combat the switching noise, estimation of the 
worst case switching noise is required. 

20 

On way of determining the worst case switching noise is to 
simulate all combinations of input patterns to determine which 
combination will induce the maximum switching noise. However, 
the complexity of the solution space is exponentially 
25 proportional to the number of primary inputs of the system. 

Accordingly, it would require an enormous time to process the 
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entire solution space for even a moderately complex system. 

As a consequence, it is almost impossible to determine all 
test patterns that cause worst case switching noise by 
5 simulation or testing. Accordingly, a small set of test 

patterns that cause at least some worst case scenarios can be 
selected. However, this way, the simulation or testing of the 
integrated circuit may not be satisfactory. 

10 The designer thus has to accept either enormous time 

requirements for simulation and testing, or potentially 
insufficient simulation or testing efficiency. This is 
clearly undesirable. 

15 To this end, some approaches have been proposed to deal with 
these problems. In "Estimation of Switching Noise on Power 
Supply Lines in Deep Sub-micron CMOS circuits'', Shiyou Zhao 
and Kaushik Roy, 13 th International Conference on VLSI Design, 
IEEE January 2000, there is proposed a probabalistic approach 

20 to determine the lower bound of the worst case switching noise 
on power supply lines. The algorithm described therein traces 
the worst case input patterns which induces the steepest 
maximum switching current spike and therefore the maximum 
switching noise. This is based on the observation that the 

25 maximum switching noise is directly related to the steepest 
maximum switching current spike. 
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In this approach, the design of an integrated circuit is 
simulated by applying randomly generated input signal vectors 
to the inputs of the circuit. For each input vector pair, the 

5 simulated peak switching current is determined. The worst 

case input vector pairs feed, as initial population, a genetic 
algorithm. The genetic algorithm is designed to single out 
the near optimal input pattern (s) that induce the steepest 
maximum switching current spike and, therefore, the worst case 

10 switching noise. The worst case input patterns are then used 
in HSPICE (simulation program with integrated circuit 
emphasis) simulation of the circuits to extract the exact 
current waveform. 

15 One problem associated with this approach is the difficulty of 
generating suitable random test patterns. The larger the 
number of random test patterns, the higher the likelihood of 
generating a test pattern which approximates the worst case 
sufficiently. However, since the simulation of each test 

20 pattern is time consuming, the simulation of a large number of 
test patterns is not practical. 

In particular, if a genetic algorithm is used, it is too time 
consuming to simulate every single random pattern out of every 
25 new pattern population before the algorithm is able to 

determine which of the patterns of the population is to be 
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selected for further optimization. Therefore, this method 
becomes saturated by the number of trial random patterns in 
each pattern population. It is suitable for small circuits. 
However, it could take up to years to perform a full chip 
simulation of a large circuit using even the fastest 
simulation applications. 

Summary of the Invention : 

It is accordingly an object of the invention to provide a 
method of approximating a behavior of an integrated circuit, a 
method of selecting test patterns, a method of simulating an 
integrated circuit, a method of testing an integrated circuit, 
a method of providing a test pattern for a simulation or a 
test of a layout of an integrated circuit, a data processing 
configuration, and a computer- readable medium having computer- 
executable instructions for performing a method approximating 
a behavior of an integrated circuit which overcome the above- 
mentioned disadvantages of the heretofore -known methods and 
devices of this general type. 

With the foregoing and other objects in view there is 
provided, in accordance with the invention, a method of 
approximating the behavior of an integrated circuit including 
the steps of : 

(a) applying a set of test patterns to a system for testing or 
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simulating an integrated circuit ; 

(b) applying the set of test patterns to a neural network ; 

5 (c) comparing outputs of the system for testing or simulating 
the integrated circuit and outputs of the neural network for 
providing a comparison result; and 

(d) adapting parameters of the neural network to approximate a 
10 behavior of the integrated circuit based the comparison 
result . 

In particular, the system for testing or simulating the 
integrated circuit may be an automatic test equipment (ATE) , 
15 and the set of test patterns is applied to the integrated 

circuit via the automatic test equipment. The neural network 
may be integrated in the ATE. It may be implemented using any 
known ATE. 

20 The invention is based on the idea that the dynamic behavior 
of the integrated circuit device can be learnt from a set of 
random test patterns using a neural network. 

This mode of operation of the neural network can be referred 
25 to as learning mode. 
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After the learning process has been completed, the ATE is able 
to perform test pattern classification. The ATE may thus 
select sub-optimal patterns for subsequent simulation or 
testing of the integrated circuit. The selected test patterns 
sufficiently approximate worst case scenarios. 

Another mode of the invention includes implementing the neural 
network in the automatic test equipment. 

Yet another mode of the invention includes generating the set 
of test patterns on a random basis. 

According to a another mode of the invention, step (d) 
includes adapting inter-unit weights of the neural network 
through back-propagation. 

Yet another mode of the invention includes repeating steps (a) 
to (d) until a level of adaptation in step (d) falls below a 
given value . 

A further mode of the invention includes storing data 
representing predetermined neural network parameters after 
terminating a repetition of steps (a) to (d) . 

With the objects of the invention in view there is also 
provided, a method of selecting test patterns, the method 
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includes the steps of : 

(a) approximating a behavior of an integrated circuit by 
applying a set of test patterns to a system for testing or 
simulating the integrated circuit, applying the set of test 
patterns to a neural network, comparing outputs of the system 
for one testing and simulating the integrated circuit and 
outputs of the neural network for providing a comparison 
result, and adapting parameters of the neural network in order 
to approximate the behavior of the integrated circuit based 
the comparison result; 

(b) applying a test pattern to the neural network whose 
parameters have been adapted to approximate the behavior of 
the integrated circuit in accordance with step (a) ; 

(c) processing an output of the neural network to determine 
whether given criteria are met; and 

(d) selecting the test pattern for storage if the given 
criteria are met. 

In other words, the invention also provides for a method of 
selecting test patterns, the method including the steps of: 

(a) applying a test pattern to a neural network whose 
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parameters have been adapted to approximate the behavior of an 
integrated circuit according to the above described method; 

(b) processing the output of the neural network to determine 
5 whether predetermined criteria are met; and 

(c) selecting for storage the test pattern if the 
predetermined criteria are met. 

10 Using this method, a sufficient number of test patterns are 
provided for an efficient simulation or testing of the 
integrated circuit. 

This mode of operation of the neural network can be referred 
15 to as operation mode. 

A further mode of the invention includes repeating steps (b) 
to (d) until a given number of test patterns have been stored. 

20 Another mode of the invention includes concluding that the 
given criteria are met if a value of a given parameter of a 
signal output by the neural network in response to applying 
the test pattern exceeds a reference value. 

25 A further mode of the invention includes the steps of: 
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(e) applying a further set of test patterns to the integrated 
circuit by using an automatic test equipment; 

(f ) measuring values of the given parameter of output signals 
5 generated by the integrated circuit in response to step (e) ; 

and 

(g) concluding that the given criteria are met if the value of 
the given parameter of the signal output by the neural network 

10 in response to applying a test pattern exceeds the reference 
value and all values measured in step (f ) . 

A further mode of the invention includes the step of 
generating the further set of test patterns on a random basis. 

15 

A further mode of the invention includes the step of using a 
dynamic current as the given parameter. 

A further mode of the invention includes the steps of: 

20 

(h) generating a test pattern population formed of a plurality 
of test patterns; 

(i) applying each test pattern of the test pattern population 
25 to the neural network; 
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(j) processing, for each test pattern, the output of the 
neural network to determine a value of a given parameter; and 

(k) allocating each test pattern to one of a plurality of 
5 classification groups in accordance with the value of the 
given parameter determined in step (j). 

A further mode of the invention includes repeating steps (h) 
to (k) using a new test pattern population formed of test 
10 patterns included in a selected one of the classification 
groups . 

A further mode of the invention includes the step of using, as 
the selected one of the classification groups, test patterns 
15 that approximate a set of worst case input parameters of 
operation of the integrated circuit. 

Another mode of the invention includes repeating steps (b) to 
(d) a number of times; applying the test patterns selected in 
20 each step (d) to a simulator for simulating the integrated 
circuit; processing an output of the simulator to determine 
whether further given criteria are met; and selecting for 
storage those test patterns that meet the further given 
criteria . 

25 

A further mode of the invention includes repeating steps (b) 
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to (d) a number of times; applying test patterns selected in 
each repetition of step (d) to the integrated circuit by using 
an automatic test equipment; processing an output of the 
automatic test equipment to determine whether further given 
5 criteria are met; and selecting for storage those test 
patterns which meet the further given criteria. 

A further mode of the invention includes the step of using, as 
the given criteria, a representation of an approximation of a 
10 worst case mode of operation of the integrated circuit. 

With the objects of the invention in view there is also 
provided, a method of simulating an integrated circuit, the 
method includes the steps of : 

15 

selecting test patterns by, in a first step, applying a test 
pattern to a neural network whose parameters have been adapted 
to approximate a behavior of an integrated circuit by applying 
a set of test patterns to a system for testing or simulating 

20 the integrated circuit, applying the set of test patterns to a 
neural network, and comparing outputs of the system for 
testing or simulating the integrated circuit and outputs of 
the neural network, and, in a second step, processing an 
output of the neural network to determine whether given 

25 criteria are met and selecting a test pattern if the given 
criteria are met; and 
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applying test patterns that have been selected to a simulator 
for simulating the integrated circuit. 

More generally, there is provided a method of simulating an 
integrated circuit, the method including the steps of applying 
test patterns that have been selected according to the above 
described method of selecting test patterns to a simulator for 
simulating an integrated circuit. 

With the objects of the invention in view there is also 
provided, a method of testing an integrated circuit, the 
method including the steps of: 

selecting test patterns by, in a first step, applying a test 
pattern to a neural network whose parameters have been adapted 
to approximate a behavior of an integrated circuit by applying 
a set of test patterns to a system for testing or simulating 
the integrated circuit, applying the set of test patterns to a 
neural network, and comparing outputs of the system for 
testing or simulating the integrated circuit and outputs of 
the neural network, and, in a second step, processing an 
output of the neural network to determine whether given 
criteria are met and selecting a test pattern if the given 
criteria are met; and 
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applying test patterns that have been selected to the 
integrated circuit by using an automatic test equipment. 

Accordingly, there is also provided a method of testing an 
integrated circuit, the method including the steps of applying 
test patterns that have been selected according to the above 
described method of selecting test patterns to the integrated 
circuit using automatic test equipment (ATE) . 

According to a preferred embodiment of the invention, the test 
patterns that have been selected in accordance with the above 
described neural network-based approach are further optimized 
using a genetic algorithm. 

With the objects of the invention in view there is also 
provided, a method of providing a test pattern for one of a 
simulation and a test of a layout of an integrated circuit, 
the method includes the steps of: 

(A) providing a set of test patterns that have been selected 
by, in a first step, applying a test pattern to a neural 
network whose parameters have been adapted to approximate a 
behavior of an integrated circuit by applying a set of test 
patterns to a system for testing or simulating an integrated 
circuit, applying the set of test patterns to a neural 
network, and comparing outputs of the system for testing or 
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simulating the integrated circuit and outputs of the neural 
network, and, in a second step, processing an output of the 
neural network to determine whether given criteria are met and 
selecting a test pattern if the given criteria are met; and 

(B) applying the set of test patterns to the integrated 
circuit by using an automatic test equipment (ATE) ; 

(C) determining outputs of the integrated circuit; 

(D) processing the outputs to determine whether given test 
criteria are met; and 

(E) depending on a determination in step (D) , generating a new 
set of test patterns based on the set of test patterns 
provided by step (A) by using a genetic algorithm. 

In other words, there is provided a method of providing a test 
pattern for the simulation and/or test of the layout of an 
integrated circuit, the method including the steps of: 

providing a set of test patterns consisting of test patterns 
selected in accordance with the above described method of 
selecting test patterns; 

applying the set of test patterns to the integrated circuit 
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using automatic test equipment (ATE) ; 

determining the outputs of the integrated circuit; 

processing the outputs to determine whether predetermined test 
criteria are met; and 

depending on the determination in the processing step, 
generating a new set of test patterns on the basis of the set 
of test patterns provided by the step of providing the set of 
test patterns using a genetic algorithm. 

This combination of neural network- and genetic algorithm- 
based approaches further increases the chances of finding test 
patterns that sufficiently approximate worst case scenarios of 
operation of the integrated circuit. 

The method employs a genetic algorithm (optimization method) 
to optimize a set of pre-selected patterns based on 
measurements using an ATE. Thereby, a set of worst case noise 
patterns can be selected automatically. By using ATE for the 
processing of the test patterns, performance is greatly 
enhanced compared to approaches based on simulation. 

Test patterns generated accordingly can additionally be re- 
simulated for further detail design analysis and improvement. 
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The genetic algorithm approach can be implemented using 
existing ATEs . 

A further mode of the method according to the invention 
includes repeating steps (B) to (E) until the given test 
criteria are met. 

A further mode of the method according to the invention 
includes repeating steps (B) to (E) until the given test 
criteria are met or repeating steps (B) to (E) a given number 
of times. 

A further mode of the method according to the invention 
includes the step of concluding that the given test criteria 
are met if the set of test patterns is associated with an 
average fitness above a given value. 

According to another mode of the invention step (E) includes 
combining some or all of the test patterns according to the 
genetic algorithm in order to provide the new set of test 
patterns . 

A further mode of the method according to the invention 
includes the step of selecting test patterns from the set of 
test patterns according to given selection criteria in order 
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to provide selected test patterns; and combining the selected 
test patterns according to the genetic algorithm to provide 
the new set of test patterns. 

5 A further mode of the method according to the invention 
includes the step of selecting a test pattern if the test 
pattern is associated with a fitness value greater than a 
reference value. 

10 A further mode of the method according to the invention 

includes the step of selecting a test pattern if the test 
pattern is associated with a highest fitness value of all 
unselected test patterns. 

Another mode of the method according to the invention includes 
the step of selecting a test pattern if the test pattern is 
associated with a highest fitness value of all unselected test 
patterns, and repeating the selecting step until a given 
percentage of test patterns has been selected. 

According to another mode of the invention step (E) includes: 

(F) sorting selected test patterns according to an order of 
associated fitness values; 

25 

(G) randomly selecting parent test patterns from test patterns 
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as sorted in step (F) ; and 

(H) combining selected ones of the parent test patterns. 

5 A further mode of the method according to the invention 

includes the step of using a mutation, a crossing over, and/or 
a re-combination for the genetic algorithm. 

According to another mode of the invention the step (A) 
10 includes providing a plurality of sets of test patterns such 
that each of the sets of test patterns is included in a test 
pattern population. 

A further mode of the method according to the invention 
15 includes the step of providing a plurality of test pattern 
populations and performing steps (B) to (E) for each of the 
test pattern populations. 

With the objects of the invention in view there is also 
20 provided, a data processing configuration, including: 

a system for testing or simulating an integrated circuit, said 
system being configured to be supplied with a set of test 
patterns ; 

25 

a neural network operatively connected to said system for 
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testing or simulating the integrated circuit, said neural 
network being configured to be provided with the set of test 
patterns ; 

5 a comparison unit operatively connected to said neural network 
and said system for testing or simulating the integrated 
circuit, said comparison unit being configured to compare 
outputs from said system for testing or simulating the 
integrated circuit and from said neural network in order to 
10 provide a comparison result; and 

an adapting unit operatively connected to said comparison 
unit, said adapting unit being configured to adapt parameters 
of said neural network in order to approximate a behavior of 
15 the integrated circuit based the comparison result. 

With the objects of the invention in view there is also 
provided, a computer- readable medium having computer- 
executable instructions for performing a method which includes 
20 the steps of: 

applying a set of test patterns to a system for testing or 
simulating an integrated circuit; 

25 applying the set of test patterns to a neural network; 
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comparing outputs of the system for testing or simulating the 
integrated circuit and outputs of the neural network for 
providing a comparison result; and 

5 adapting parameters of the neural network to approximate a 
behavior of the integrated circuit based the comparison 
result . 

More generally, according to the invention, there is provided 
10 a computer program for performing any of the methods according 
to the invention and a data processing system, adapted to 
perform any of the methods according to the invention. 

Other features which are considered as characteristic for the 
15 invention are set forth in the appended claims. 

Although the invention is illustrated and described herein as 
embodied in method of processing test patterns for an 
integrated circuit, it is nevertheless not intended to be 
20 limited to the details shown, since various modifications and 
structural changes may be made therein without departing from 
the spirit of the invention and within the scope and range of 
equivalents of the claims. 

25 The construction and method of operation of the invention, 
however, together with additional objects and advantages 
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thereof will be best understood from the following description 
of specific embodiments when read in connection with the 
accompanying drawings . 

5 Brief Description of the Drawings : 

Fig. 1 is a schematic illustration of a classification of 
three groups of test patterns; 

Fig. 2 is a flow chart illustrating a process representing the 
10 neural network learning mode according to an embodiment of the 
invention; 

Fig. 3 is a flow chart illustrating a process representing the 
neural network operation mode according to an embodiment of 
15 the invention; 

Fig. 4 is a schematic flow chart of a genetic algorithm using 
an initial random pattern generation according to the 
invention; and 

20 

Fig. 5 is a flow chart illustrating a method combining a 
neural network-based pre-selection of test patterns and a 
subsequent optimization using a genetic algorithm according to 
the invention. 

25 
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Description of the Preferred Embodiments : 

In accordance with one embodiment of the invention, a neural 
network model is implemented into the ATE. That is, the ATE 
is able to learn automatically from test runs of an integrated 
5 circuit performed on the ATE. After training of the neural 

network has been completed, it is able to identify which group 
of test patterns belong to a sub-optimal set. For this 
purpose, some million test patterns are selected vie the 
neural network. Subsequently, the pre-selected sub-optimal 
10 pattern is simulated (simulation approach) or measured (ATE 
approach) to further determine which of the patterns fulfill 
predetermined criteria. Those patterns which fulfill the 
criteria are selected for storage. 

15 Fig. 1 illustrates schematically a classification of three 
groups of patterns. Since the simulation approach- or ATE 
approach-based selection of patterns is performed on the basis 
of a sub-optimal set of patterns (group C) , the speed and 
efficiency compared to conventional methods for identifying 

20 suitable test patterns is considerably improved. This 
approach is referred to as maximum approximation. 

Suppose, as illustrated in Fig. 1, there are 

P n g{p n a P n b P n c \ N>0 , three groups of test patterns within a 
25 full range of all possible test patterns. Instead of 
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searching through all possible patterns, the neural network 
may learn and distinguish between different groups of test 
patterns using an ATE-based training program. Accordingly, 
the test patterns are pre-classif ied . 

In the maximum approximation algorithm mode, the sub-optimal 
set P N C and P N B n P N C are generated based on neural network 
decisions, and a sub-optimal pattern set forms a new pattern 
population . 

This process can be repeated iteratively on the basis of the 
new pattern population, thereby to select the best group of 
patterns out of the sub-optimal population, and so on. 

A neural network is an interconnected assembly of simple 
processing elements, units or nodes, whose functionality is 
loosely based on that of the animal neuron. The network 
ability of the network is stored in the inter-unit connection 
strengths, or weights, obtained by a process of adaptation to, 
or learning from, a set of training patterns. 

Fig. 2 illustrates a process representing the neural network 
learning mode according to an embodiment of the invention. 
The neural network is based on back-propagation net 
characteristics to perform a pattern classification task. In 
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the beginning, the neural network learns from a set of random 
patterns. The test results are supervised by a test system 
(ATE) . The learning process is terminated when the learning 
error is less than a predetermined value. Subsequently, a 
neural network learning weight ("brain") file is generated. 
This file is then used in operation mode to perform a pattern 
classification task. 

Fig. 3 illustrates a process representing the neural network 
operation mode according to an embodiment of the invention. 
In the operation mode, the neural network is able to perform 
pattern classification based on previous learning experience 
(contained in the NN brain file) for pattern approximation and 
selection. The procedure of pattern selection may be based on 
a very small set of NN pattern populations. For example, one 
NN pattern population may include six NN decision patterns. 
The neural network first determines whether any pattern out of 
these six NN decision patterns belong to a potential maximum 
current group (sub-optimal group) . If yes, then this pattern 
is selected. If no, then the search is repeated using the 
same procedure. In the final network classification, only 
those patterns are selected which cause a higher dynamic 
current than patterns that have been tested in real 
measurements (RSMA) . For example, using this approach, 6*100 
= 600 patterns can be classified, of which only 100 patterns 
require testing through measurement to determine if they cause 
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higher dynamic currents, while the other 500 patterns are 
classified by the neural network. 

An implementation of the neural network pattern learning 
process and the neural network pattern classification process 
is given in Annex 1 and Annex 2, respectively. 

In one embodiment of the invention, the neural network is a 
back-propagation neural network. Back-propagation is a 
supervised learning algorithm mainly used by multi-layer- 
perceptrons in order to change the weights associated with the 
net's hidden neuron layer (s) . 

Another embodiment of the invention will now be described by 
reference to Figs. 4 and 5. In this embodiment, test patterns 
selected by the neural network are further optimized using a 
genetic algorithm. 

For the purposes of illustration, Fig. 4 shows a schematic 
flow diagram of a genetic algorithm without pre-selection of 
test patterns by a neural network (instead, the initial 
patterns are generated on a random basis) . 

Fig. 5 illustrates a schematic flow diagram of a method 
combining neural network-based pre-selection of test patterns 
and subsequent optimization using a genetic algorithm, in 
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accordance with an embodiment of the invention. 

Genetic algorithms are based on the principles of natural 
selection. In particular, genetic algorithms are stochastic 
5 search methods which simulate natural biological evolution. 
The algorithms operate on the basis of a population of 
potential solutions and, applying the principle of w survival 
of the fittest" to these potential solutions, produce a better 
approximation of a target solution in each iteration of the 
10 algorithm. 

Each iteration of the algorithm produces a new generation of 
approximations. The approximations of each generations are 
created by the process of selecting individuals according to 

is their level of "fitness" in the problem domain. The selected 
individuals are bred with one another using operators borrowed 
from natural genetics. This process leads to the evolution of 
populations of individuals that are better suited for their 
environment than the individuals from which they were created, 

20 just as in natural adaptation. 

Accordingly, genetic algorithms model natural processes such 
as selection, cross over, recombination and mutation. 

25 Fig. 4 shows a method for detecting the worst case current 
consumption/peak current pattern (RSMA) based on a genetic 
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algorithm. This method operates on the basis of populations 
of individual patterns instead of a single pattern solution. 
In this way, the search for better approximations can be 
performed in a parallel manner. Therefore, this method is 
more efficient than single pattern searching processes using 
dynamic random algorithm methods. 

Genetic algorithms may be employed for the simulation of an 
integrated circuit design in order to solve the worst case 
pattern search problem. The efficiency of genetic searching 
procedures is largely dependent on the number of pattern 
populations and the number of test patterns in each pattern 
population. However, as indicated above, the simulation-based 
approach forms a limitation if genetic algorithms are to be 
employed. The genetic selection procedure has to evaluate 
every "fitness" (dynamic peak/averaged current) of the test 
patterns in each pattern population. For example, there may 
be 200 pattern populations each including 20 patterns. Thus, 
the genetic algorithm has to evaluate the fitness of 200 * 20 
= 4,000 patterns. If each test pattern is a 50 cycles test 
pattern which requires 30 minutes of simulation time (e.g. 
EPIC or SPICE simulator) , then the total required searching 
and simulation time is 4,000 * 30 minutes = 120,000 minutes, 
i.e. approximately 83 days of non stop simulation in order to 
process 200 pattern populations only. 
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In addition, the full pattern combination domain increases 
proportionally to the complexity of VLSI (Very Large-Scale 
Integration) or ULSI (Ultra Large Scale Integration) designs. 
Therefore, a subset of 2 00 pattern populations is only a very 
5 small subset of the full pattern combination domain. 

In contrast, when using a genetic algorithm together with ATE, 
many more pattern populations per time unit can be processed. 
This is because the testing of an integrated circuit using ATE 
10 is considerably faster than simulation using conventional 

systems. Accordingly, the approximation of worst case test 
patterns in a given period of time is much more accurate. 

An implementation of a dynamic genetic algorithm for use with 
15 ATE is presented in the following. At the beginning of the 
computation, a number of individual random patterns 

P/° P ={p 1 ,P 2 . .P N ) (!> 

20 are randomly generated and initialized, wherein N is the 
maximum number of random patterns and POP is the maximum 
number of pattern populations. 

Subsequently, for each individual pattern (pi, p 2 , Pn) , the 
25 objective functions 



-29- 



M&N-IT-465 



5 



/^(V I samp ,e{P N . SRMS)) (2) 

and 
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are evaluated using equation (4) : 
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T = SRMS {T m in' T mwi )=> Random _Float _Number {T min ,T max ) 

T nax — T min t ^T min , T m(JX > 0, 1 Measurement (f*N > peak ? averaged } 



10 The first (initial) generation is thus produced, and the 

averaged fixness of the individual patterns (pi, p 2 , . . • , Pn) is 
calculated using equation (5) : 

N 

^^jl Measurement C^Af ) 

Averaged_Fixness (Fixness (P™ P ))=— — , N, P N >0 (5) 

Fixness (P N ) = I Measurment {P N , T)e { I peak I averaged } 



15 

If the optimization criteria 

(Averaged_Fixness{ I Measurement { P N° P ))< I max^ref ) ( 6 ) 

20 is not met for any existing population, a new population is 
created on the basis of the existing population. Individual 
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patterns are selected according to their fitness for the 
production of offspring (loopl in Fig. 4) . 

In this selection approach, the basic concept of tournament 
selection is employed. That is, only the best individual 
pattern from the existing population is selected as a parent. 
This process is repeated until a pre-defined percentage of 
best patterns has been selected: 

(7) 

Sorting^ I Measurement { I min {P^ mia ) — I^JPs^ )))=> Parent {l Measurement {P N )) 

Ne{N min N m J Ne {N min =N max -(^xfi) N^} 

wherein B is the pre-defined percentage of the best pattern 
group. The sorting function first re-arranges the test 
patterns from minimum to maximum according to their fixness 
15 values. Subsequently, the parent selection is generated in 
random sequence based on the new sub-optimal fixness range N, 
which is calculated using B. Parents (selected patterns) are 
combined using cross over (8), re-combined (9) and mutated 
(10) in order to produce offspring 

20 

Crossover (P N (C 7 , C 2 \ P N+I (C 3 , C 4 )) => Upper jCrossOver (P N (C 3 , C 2 ), P N+I (C y , C 4 )) 

=> Lower JCrossOver {P N (C y , C 4 ) t P N+J {C 3 , C 2 )) ( 8 ) 
=> StripejCrossOver (P N {C 4 , C 3 ), P N+1 (C 2 , C ; )) 

where C is the test pattern content which is selected for 
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cross over of two patterns. In the cross over process, upper, 
lower or stripe cross over methods are performed in random 
se q uence/ an d the contents of two cross over patterns are 
exchanged in order to produce two new offspring patterns. 

5 

Thereafter, the re-combination equation (9) is used to select 
the best fixness pattern out of two new cross over offspring 
patterns : 

1 o Recombination (P N , P N+1 ) 

I maximum 



20 



Mutation{P M {C l ,C 2 ,C 3 ,C 4 ....C y )) P M (C, +R n C 2 +R 2 > C y +R y ) 

R y e{l 0 -l\M,P M ,y>0 



(10) 



where M is the number of new selected offspring patterns to 
15 form the new population. After recombination, the offspring 
undergoes mutation. Offspring variables are mutated by the 
addition of small random values 

Ry e (7 0 -/) (11) 



The mutation process helps to improve the optimization search 
process . 



Finally, all offspring patterns are inserted into the 
25 population, replacing the parents (original pattern 
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population) and producing a new generation. This cycle (loop 
1 in Fig. 4) is performed until the optimization criteria are 
met. If the fitness does not improve after a pre-defined 
number of genetic breeding generations, a new pattern 
population (loop 2 in Fig. 4) will be generated in random 
sequence. This combination greatly increases the chances of 
finding worst case test patterns. 

A complete implementation of this algorithm using ATE J973 is 
given in Annex 3 . 

Fig. 5 illustrates a flow diagram of a method combining neural 
network-based pre- selection of test patterns and subsequent 
optimization using a genetic algorithm. 

A complete implementation of this combined approach using ATE 
J973 is given in Annex 4. 

It is to be noted that the invention is not restricted to the 
embodiments and implementations described herein but 
encompasses modifications and variations within the scope of 
the invention as determined from the claims. 



Annex 1: 



Neural Network Pattern Learning Implementation Using 
ATE J973 
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Start Neural Network Training Using ATE: Circuit Initialization 

5 

Default AC/DC Specification Initialization. 

DP Dummy Pattern: Vector Memory Initialization 

INPUT: {N Vector joycle DP Auto_Range e G Epoch Max_Loop EX File_Name} 

10 

Check if Input valid? 
else Input Error! exit(l). 

For PI = 0, 1,2,3, ,AutoJlange+l do : (Automatic Input & Output Range 

15 Calculation) 

{ 

Random_PatternjGeneration => P<z{p lt p 2 , ,p N ): Random Pattern Population 

V vector _cycle f N > 0 



X{P N , I peak/averaged i^N )) G I > ^2 % i\ ^offset = max ~ ^ ' min ) X ^offset > ^offset > * > 
X i ^ \X m in ~ X min + X offeset } 

X 2 e \X midII = X min — 1 X midl2 = X min + X offset } 
X 3 e \x mid21 — X midl2 — 1 X mid22 = X mid2l + X offset \ 
X 4 ^ {x max = X mid22 — l} 

} 
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Neural Network Training Loop: 



{ 



Random Pattern Generation 



Pe(p lt p 2 , ,p N ): Random Pattern Population 

\ f vector _cycle t N > 0 



Vector _Code_Matrix(P N {Vector Cycles)) = 



P 0 (VectorjCylces) 
Pj (Vector Cycles) 

P N (Vector_Cycles\ 



P N (Vector_Cycles)e P N {yector_encode{^ signal _bus\ Vector jCycles) (ATE Training Set) 

i o Pattern _ Generator(Vector _ Memory(P N )) 

=> Pattern jContr oiler {Vector _Memory(P N )) N>0 (Pattern Executor) 

Start Pattern Generator: P N (T^ , 7^ ) => Dynamic Pattern 

is Start Current Measurement & Calculation: 

XP N J)= VDD ^ N ' T) ^ T ]v DD {P N ,T)dT^AI CMOS {P N ,T\ \/T,P N >0 

K eff L eff T mto 

T = SRMS{T nin ,T max )^> Random_Float_Number{T min , ) 

* max — min ' min ' * max 



Measurement y 



20 
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Stop Pattern Generator: P N : I peak ^I sample {P N . SRMS )) I averaged {P N ,SRMS) 



Z — I Measurement if*N *^)^ {f peak ^ averaged} 



X k (P N J Measurement (P N )h{^ X i) (Neural Network Learning Set) 



1 + e 



XxG 



E =~XS( y /* ~ z jJ (Supervising Learning via ATE) 

2 k=i j=i 



10 



dE 



w ji = w ji- sx 



xG 



E(P N y = E(P N ) (pattern population Learning Error calculation) 
Training_Loop+ + 



15 



if (Training_Loop>Epoch) (pattern population learning done) 



Epoch 



if (Training_Loop>Max_Loop) 

{ So Far Neural Network Learning File (File_Name) Generation, exit (1)} 



20 
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if(E>EX) 

{ Go To Neural Network Training Loop: Learn Again!! Initialize: E=0} 

else 

{ expected Neural Network Learning File (FileJSTame) Generation, exit (1)} 

} End of Neural Network Learning 

Final Neural Network Learning Plot Generation 

End Of Neural Network Learning via A TE 

Annex 2: Neural Network Pattern Classification 
Implementation Using ATE J973 

Start NN_MA : Circuit Initialization 

Default AC/DC Specification Initialization. 

DP Dummy Pattern: Vector Memory Initialization 

INPUT: {N Vector jcycle DP MaxJLoop File_Name} 

Check if Input valid? 
else Input Error! exit(l). 

NNJLearning_File (File_Name)e { w (J e G X k } 



J 
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NNJMA_Loop: 

{ 

Random _Pattern__Generation => Pe(p } ,p 2 , ,p N ): Random Pattern Population 

\j f vector _cycle,N > 0 

X k (r».I— frf x * X*} (Neural Network Evaluation Set) 

i 

ifiyY N (x)< Y sub optional set ) 

{ Go to NN_MA_Loop : New Pattern Population Generation !!! } 

else 

{ Sorting(P N , Y N (x)) => P M (Sub-optimal set based on 
neural network)} 



Vector _Code_Matrix(P M (Vector _Cycles))~ 



P 0 (Vector_Cylces) 
PjiyectorjCycles) 

Pm {Vector jCycles) 



P M (Vector_Cycles)e P M (vector jencode(y signal Jbus), Vector JCycles)) 
Pattern _Generator(V ector_Memory(P\f)) 

=> Pattern jController (Vector _Memory(PM)) M>0 (Pattern Executor) 
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Start Pattern Generator: P M (T min ,T max ) => Dynamic ^Pattern 
Start Current Measurement & Calculation: 

I M ea,^{P M .T) = ^^ Vr.P, >0 

K eff T aia 

T = SRMS (T min ,7^ )=> Random_Float_Number (T^.T^ ) 
5 > , VT^, ,T max >0 

Stop Pattern Generator: P M : /^(V/^ te (P M .5iiM5)) / avera8ed (^,5/?M5) 

I Measurement C^M *^0^= i^pea* ^ averaged I 

10 NN_Max_Loop + + (operating loop counter) 

Sortfnsfa, , (/>, ))=> ^„ (best out of sub-optimal set via ATE) 

tf^J Measureent (/^selected ) ^ ^ ^ Measurement ^J* previous _selected )) 

15 { Update VCM Database File } 

if{NN_Max_Loop < MaxJLoop) 

{ Go to NN_MA_Loop : New Pattern Population Generation!!! } 
else 

20 { Final VCM Database File Generation exit(l)} 
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Final Neural Network Maximum Approximation Plot Generation. 
End Of NN_MA 

5 Annex 3: Dynamic Genetic Algorithm Implementation Using ATE J973 

Start DjGA: Circuit Initialization 

Default AC/DC Specification Initialization. 
10 DP Dummy Pattern: Vector Memory Initialization 

INPUT: {N VectorjCycles DP Loopl Loop2 iMaxjie/} 

Check if Input valid? 
15 else Input Error! exit(l). 

For POP = 0,1,2,3, ,Loop2+l do: 

{ 

Random pattern generation ^=> P^{p l >p 2 > >Pn) 

2 o V vector _cycle, N >0 

p£° p ={p 1 ,p 2 > -P N ) Initial Pattern Population 

ForPl=0, 1,2,3, ,N+1 do: 

{ 

25 
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Vector Code _Matrix (p n (Vector _Cycles))=> 



P 0 (Vector _Cycles) 
P x (Vector ^Cycles) 

P N {Vector ^Cycles) 



P N (Vector_Cycles)e P N (vector encode^ 'signal _bus),Vector_Cycles)) 
Pattern ^Generator (Vector ^Memory (P N )) 

=> PatternJOontroller (Vector JAemory (P N )) N>0 (Pattern Executor) 



10 



Start Pattern Generator: P N (T^ , ) => Dynamic _ Pattern 
Start Current Measurement & Calculation: 

/— — v -*^+±fr r„(r..r)ir ♦ Ai cuos (p„,T)yzp„ > o 

T = SRMS (T^.T^)^ Random_Float_Number {T min ,T max ) 
T^T^n ,^T min ,T max >0 

Stop Pattern Generator: P N : I ^ ( V/ Jflmp/e {P N , SRMS)), I averaged {Ps > SRMS) 

FixneSS {P N )= I Measure meM ( P N' T ) e \. J peak ^averaged} 

} 

I Measurement C^AT ) 

Averaged_Fixness [Fixness fe OP ))=^ ,N,P N >0 



20 if ( Averaged_Fixness ( / Me<uuremM )) > / ) 
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{Final VCM Generation {Database l) exit (l) } 

For P2 = 0, 1, 2, 3, Loopl+l do: 

{ 

5 Sorting (l Meaurement {P w )<={l mi „(P Nm J /„„ (P Nmx )})=> Parent (P N )) 

{N min N m J Ne{N min =N max -(N ma xB)N max } 

Crossover {P„ {C, , C 2 ), P N+I (C 3 ,C 4 )) => UpperjCrossOver (P N {C 3 , C 2 ), P N+1 {C, , C 4 )) 

=> Lower CrossOver (P N (C, , C 4 ), P N+I (C 3 , C 2 )) 
=> Stripe _CrossOver (P N (C 4 , C 3 ), P N+1 (C 2 , C 1 )) 

i o Recombination (P N , P N+l ) => (P N , ) => I Best (P M ), N, M,P N >0 

Mutation{P M {C,,C 2 ,C 3 ,C 4 ....C y )) => P M {C, + Rj , C 2 + R 2 C y + R y ) 

=> R y <={l 0 -l},M,P M ,y>0 

ForP3 =0,1,2,3, ,M+1 do: 

{ 

1 5 Pattern _Generator (VectorMemory (P M )) 

=> PatternJZontr oiler (Vector_Memory (P M )) M >0 (Pattern Executor) 

Start Pattern Generator: PM(T mini T maj( )=> Dynamic Pattern 
Current Measurement & Calculation: 

20 
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10 



T = SRMS {T mint T max )=* Random J?loat Number (T^T^) 
T max — T min , ^T min , T max > 0 

Stop Pattern Generator: P u : I ^ {^I sample (P M , SRMS )} I averaged {P M ,SRMS) 

Fixness {P M ) = I Measuremem (P M ,T)e {l peak I averaged } 

} 

M 

^ ' ^Measurement C^A/ ) 

Averaged ^Fixness {Fixness \P™ P ))= — >M,P M >0 

M 

if ( Averaged_Fixness ( I Measurement {p pop ))> I Max REF ) 

{ Worst Case Pattern Found : Final VCM Generation {Database l)exit(l)} 

} End Of Loop 1 
} End of Loop 2 



Update So Far Worst Case Pattern Found : Final VCM Generation (Database l) 
15 End of D_GA 
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Annex 4: Combined Neural Network Pattern Classification and Dynamic Genetic 
Algorithm Implementation Using ATE J973 



Start NN GA: Circuit Initialization 

Default AC/DC Specification Initialization. 

DP Dummy Pattern: Vector Memory Initialization 

INPUT: {N Vector jzycle DP Max_Loop Loopl I M ox^ref Filejfame} 

Check if Input valid? 
else Input Error! exit(l). 

NN_Learning_File(File_Name)^{w ij e G X k ] 

NN_GA_Loop: 

{ 

Random Pattern ^Generation =>Pe (/? / ,/? 2 ,...., j p jV ): Random Pattern Population 

V vector cycle, N>0 

xk ( P N^MeasureenXPN))^{^f X k 2 } (Neural Network Evaluation Set 

i 

^ sub optimal _set ) 

{ Go to NN_MA_Loop: New Pattern Population Generation!!! } 

else 

Sorting (P N Y N (x))=> P M (sub — optimal set based on neural network) 
P M => P N (replacing the old population with new sub - optimal set) 

For PI = 0,1,2,3, , Loopl + 1 do : (Start genetic algorithm to further improve sub- 
optimal set) 

{ 

Sorting (/„_„, (P N )e {l min (P^ ) )))=> Parent {l Measurment (P N )) 

N^{N min N^} 

{N nin =N max -(N max xB) N m J 

Crossover {P N {C„C 2 ),P N+1 {C 3 ,C 4 )) => Upper _CrossOver{P N {C 3 ,C 2 ),P N+ ,{C„C 4 )) 

=> LowerjCrossOver {P N (C, , C 4 ), P N+ , (C 3 , C 2 )) 
Stripe jOrossOver (P„ (C 4 , C 3 ), P N+1 (C 2 , C, )) 
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Recombination (P N , P N+I ) => I maximum {P N , P N+l )=>I Besl {P M ), N, M,P N >0 

Mutation{P M {C l ,C 2 ,C 3 ,C 4 ....C y )) => P M (C 1 + R, ,C 2 + R 2 C y +R y ) 

=> R y e{l 0 -l},M,P M ,y>0 

For P3 =0,1,2,3, , M+l do: 

5 { 

Pattern _Generator (Vector _Memory (P M )) 

Pattern Controller (Vector_Memory (P M )) M >0 (Pattern Executor) 

Start Pattern Generator: PM(T m i n , T max )=> Dynamic ^Pattern 
10 Current Measurement & Calculation: 

/«*~te,T)=£a^^ >0 
T = SRMS (r OTI „,r max )=> Random_Float_Number {T min ,T max ) 



15 



T m > 7V,„ , V7\,„,7' > 0 

max mm ' mm max 



Stop Pattern Generator: P M : I peak {\fI sample (P M ,SRMS)), I averaged {P M ,SRMS) 

FixneSS (P M ) = 1 Measurement (P M '^) e { I peak I averaged I 

} 

M 

^Measurement C^A/ ) 

Averaged_Fixness (Fixness (p™ p )) = ^ — ,M,P M >0 

20 if{Averaged_Fixness ( 

•^Measurement 

(PM° P ))>I MaxREF ) 

{Worst Case Pattern Found : Final VCM Generation (Database l) exit(l)} 

} End of Loop 1 

25 NN_Max_Loop + + (operatiang loop counter) 

if (NN Max Loop < Max Loop) 

{ Go to NNGALoop: New Pattern Population Generation! ! !) 
else 

3 0 { So Far Worst Case Pattern Found : Final VCM Generation (Database l) exit(l)} 

> 

Final Neural Network _ + GA Plot Generation (Fig. 31) 
End of NN+GA 
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